Space-Efficient Support for Temporal Text Indexing in a Document Archive Context

Support for temporal text-containment queries (query for all versions of documents that contained one or more particular words at a particular time t) is of interest in a number of contexts, including web archives, in a smaller scale temporal XML/web warehouses, and temporal document database systems in general. In the V2 temporal document database system we employ a combination of full-text indexes and variants of time indexes to perform efficient textcontainment queries. This approach was optimized for moderately large temporal document databases. However, for “extremely large databases” the index space usage of the approach could be too large. In this paper, we present a more spaceefficient solution to the problem, the architecture of the interval-based temporal text index (ITTX), we present appropriate algorithms for update and retrieval, and we discuss advantages and disadvantages of the two approaches.